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parameter  Sc [-1,1],  it  is  shown  that  if  data  are  collected  according 
to  a  particular  stopping  rule,  the  least  squares  estimator  of  8  is 
asymptotically  normally  distributed  uniformly  in  0.  In  the  case  of 
normal  residuals,  the  stopping  rule  may  be  Interpreted  as  sampling  until 
the  observed  Fisher  information  reaches  a  preassigned  level.  The  situation 
is  contrasted  with  the  fixed  sample  sise  case,  where  the  estimator  has  a 
non-normal  limiting  distribution  when  |8|  -  1. 
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FIXED  ACCURACY  ESTIMATION  OF  AN  AUTOREGRESSIVE  PARAMETER 


1.  Introduction  and  Summary. 

Consider  the  first  order ,  non-explosive ,  autoregressive  model 

(1.1)  x  *  3x  -  +  e  (n  -  1,2,...)  , 

n  n-i  n 


where  ei»e2’***  are  independent,  identically  distributed  random  variables 

2  2 

with  Ee1  «•  0  and  0  <  Ee^  -a  <  ».  The  initial  state  x^  is  a  random 
variable  (not  depending  on  3)  which  is  stochastically  Independent  of  (en) . 
The  constant  Be[-l,l]  is  an  unknown  parameter,  which  at  stage  n  is 
customarily  estimated  by  the  least  squares  estimate, 

n  n  .  n  n  . 

(1.2)  b  =  (  Z  X,  -x. )/(E  xf  .)  -  $  +  (  Z  X  e  )/(Zx  )  . 

n  i-1  i'1  1  i-1  11  i-1  111  1  1  1 


If  the  e's  are  normally  distributed,  then  b&  is  also  the  maximum  likeli¬ 
hood  estimator  of  3,  and  the  observed  Fisher  information  about  3  contained 


in  Xq.Xj . *n  is 


(1.3) 


,2  n  _  n  n 

-  (3  I  x.  .x.  -  3V2  E  xf  .) 

d3  i-1  i-1  1  1 


n 

Z  x 
i-1 


2 

i-1  * 


It  is  well-known  and  easy  to  prove  that  for  fixed  Be(-l,l),  as 


n  «* 

(1.4)  (Ex^_1)1/2(bn-3)  i  N(0,O2)  . 

Here  N(y,a2)  denotes  a  normal  random  variable  with  mean  y  and  variance 
o2,  and  &  indicates  convergence  in  law.  See,  for  example,  Anderson  (1959). 


However,  for  $  -  +1,  an  entirely  different  limiting  distribution  occurs 


(Rao,  1978).  For  example,  if  8  ■  1,  x  -  Xq  is  the  sum  of  1.1. d.  random 

variables  e,  +  •••  +  e  ,  and  summation  by  parts  in  (1.2)  yields 
x  n 


i-1 


i-l 


x2  )1/2 

xi-l; 


By  Donsker's  theorem  this  converges  in  law  to 

(1.5)  |(W2(l)-l)/(/w2(t)dt)1/2  , 

0 

where  (V(t),  0  £  t  £  1}  is  a  standard  Brownian  motion  process.  Of  course, 
this  result  indicates  that  the  asymptotic  normality  of  (1.4)  breaks  down  for 
8  in  a  neighborhood  of  +1,  in  the  sense  that  for  any  given  n,  no  matter 
how  large,  there  will  be  a  neighborhood  of  +1  in  which  one  should  not  expect 
(1.4)  to  yield  reasonable  approximations. 

Examples  in  econometrics  having  values  of  8  close  to  1  are  cited  by 
Evans  and  Savin  (1981)  and  by  Fuller  (1981). 

In  this  paper  we  consider  the  asymptotic  behavior  of  (bn)  under  a 
sequential  sampling  scheme  which  measures  time  in  terms  of  accumulated 
(observed)  Fisher  information.  Define 

n  2  2 

(1.6)  N  ■  first  n  >  1  such  that  Ex.  .  >  ca  . 

c  -  li*1" 

Our  principal  result  (Theorem  2.1)  is  that  as  c  -*•  <*> 

Hc 

(1.7)  (  ExJ_1)1/2(b  -8)  £  N(0,o2) 

1  c 

uniformly  in  8  for  -1  £  8£  1. 


2 


The  sampling  rule  (1.6)  is  motivated  by  Che  theory  of  fixed  width 

confidence  intervals ,  cf.  Anscombe  (1953),  Chow  and  Robbing  (1965),  or 

Grambsch  (1982).  Some  precedent  for  the  rather  surprising  uniformity  in 

the  convergence  of  (1.7)  is  found  in  the  work  of  Siegnund  (1981),  although 

the  underlying  reasons  are  quite  different  in  the  present  case. 

When  it  is  feasible  to  use  the  sampling  rule  (1.6),  its  advantages 

appear  to  be  threefold:  (i)  the  accuracy  of  bN  as  an  estimator  of  0  (as 

c 

measured  by  the  variance  of  its  asymptotic  distribution)  is  approximately  a 

small  constant  c"*\  rather  than  an  uncontrolled  random  variable,  (ii)  the 

appropriate  asymptotic  distribution  theory  does  not  depend  on  the  value 

of  the  unknown  parameter  8;  and  (iii)  the  convergence  to  asymptotic  normality 

is  much  more  rapid,  even  when  $  is  not  near  the  values  +1.  (See  Section  3.) 

The  remainder  of  this  paper  is  arranged  a a  follows.  Section  2  contains 

a  proof  of  (1.7).  In  Section  3  we  give  the  results  of  some  simulations 

comparing  confidence  intervals  obtained  by  indiscriminate  use  of  (1.4)  for 

fixed  sample  sizes  with  (1.7)  for  sequentially  determined  sample  sizes. 

Section  4  is  concerned  with  some  related  asymptotic  results,  and  in  particular 

the  appropriate  modification  of  (1.6)  when  0  is  unknown. 

Partial  results  for  the  model  x  ■  a  +  8x  .  +  e  indicate  that  the 

n  n-i  n 

multiparameter  case  can  be  appreciably  more  complicated.  We  expect  to 
consider  this  problem  in  the  future. 

2.  Uniform  Asymptotic  Normality  of  b^  . 

c 

The  main  result  of  this  section  is  the  proof  of  (1.7)  (Theorem  2.1 

below) .  Our  approach  is  motivated  by  the  obeervatlon  that  b -  8  ■ 
n  n  , 

Z  x.  ,e  /  Z  xi  .  is  of  the  form  of  a  martingale  divided  by  the  sum  of 
i-1  1  i-1 


3 


Che  conditional  variances  of  its  Increments.  The  novelty  of  our  approach 
lies  in  systematic  exploitation  of  the  condition  (2.6)  and  the  simple 
identity  (2.16).  We  begin  with  sene  preliminary  probabilistic  results. 


Proposition  2.1.  Let  xq>  eft,  n  *  0,1,...  be  random  variables  adapted 

to  the  increasing  sequence  of  O-algebras  3q,  n  •  0,1,...  .  Let 

{Pg ,  0eE}  be  a  family  of  probability  measures  such  that  under  every  Pg 

2 

(2.1)  are  i.i.d.  with  •  0,  EgEj^  ■  1  } 

(2.2)  aup  Eg{e^;  >  a)  0  as  a  -►  ®  ; 

9 

(2.3)  e  is  independent  of  3  ,  for  each  n  >  1  ?, 

n  n-i 


(2.4) 


P.{  E  x?  -  «•}  •  1  ; 
9  i-0  1 


(2.5) 

(2.6) 


2 

sup  Pa{x  >  a)  -*■  0  as  »-*■■>  for  each  n  >  0  ; 

0  0  n  - 

2  n“^  ? 

lim  [sup  Pn{x  >6  !  x.  for  some  n  >  m}]  •  0  . 

m  -  «  0  9  n  “  i-0  1 


Por  c  >  0  let 


(2.7) 


n  2 

T  «  inf{n:  Exf  .  >  c} 
c  l  1-1  ~ 


(inf  ^  ■  +  ■) 


Then  uniformly  in  0eH  and  -«o  <  t  <  «• 


(2.8) 


Pe(c"1/2  E  *i_1e1  <  t}  •*>  *(t)  as  c  • 


A 


Remark.  For  the  autoregressive  model  (1.1),  if  we  identify  6  with 
the  autoregressive  parameter  $,  all  the  conditions  of  Proposition  2.1 
are  trivially  verified,  with  the  single  exception  of  (2,6). 

Proposition  2.1  is  proved  by  reducing  it  to  the  following  convenient 
martingale  central  limit  theorem  (cf.  Freedman,  1971,  pp.  90-92). 

Lemma  2.1.  Given  0  <  6  <  1,  there  exists  p(6)  >  0  with  lim  p(6)  -  0 

6-^0 

such  that  for  any  martingale  difference  sequence  {uq,  n  >_  0}  satisfying 


(2.9) 

|u  1  <  5  for  all  n 
•  n 1  — 

and 

00 

(2.10) 

o 

Z  E(u  III  -i )  ^  r  a* 8*  f 
j  n*  n-l 

if 

n  e 

t  -  inf{n:  Z  >  r),  then  P{t  <  *}  •  1 

and 

sup|p{£  u  <  x}  -  *(x/r1/2)|  <  p(5/r1/2)  . 

x  1 


Proof  of  Proposition  2.1. 

By  (2.4)  P.{T  <  <*>}  -  1,  and  obviously  Pfl{  lim  T  ■  ■  1  for 

w  C  "  c  ♦  *  ** 

s /2 

all  e.  Let  0  <  6  <  1  and  define  i  -  x„  if  xz  <  6zc  and  x  -  6c 

n  n  n  u 

otherwise.  Then  for  all  6 

P«{x  i*  x_  for  some  n  <  T  } 
o  n  n  c 

<  Z  p0ixi_i  >  +  Pe^Tc  >  ■»  xn  *  *n  for  *am  ■  -  n  <  T* 

i»l 

<  pe(*!-i  »  4*«>  +  pe(*«  i  ‘2  V  "i  ,or  ’ 


3 


which  i«  <26  if  w  first  choose  a  larga  enough  and  uaa  (2.6),  than 
chooaa  c  larga  and  uaa  (2.5).  Hence  if 

Q  •  {*„  ■  i  for  all  n  <  T  }  , 

c  n  n  c 

than  for  all  larga  c 

(2.11)  P(nc)  >1-26 

Define  eR  -  enI ( | I  <  »nd  ?n  -  en  -  en.  Than  under  P0 

{c~  l/2j 

(e  -EQe  ),  3  ,  0  <  n  <  “>)  is  a  aartingale  difference  aaquance 
n— 1  non  n  — 

satisfying 

l'‘1\l<vV.>  I  i  “l/2  • 


and  by  (2.4) 

*n  •  ->  ■  1 

also  by  (2.2),  as  6  -*■  0 


(2.12) 


v0(6)  -  var0e1  -  1 


uniformly  in  6.  Hence,  if 

®  * 

T  ■  inf (n:  E  if  ,  >  c}  , 
c  j.  i~l 


then  by  Lem  2.1 


6 


(2.13)  |P0{c“1/2  E  *1_1(VBeg1)it}-*(t/(v0(«))1/2)|  <  Pt2(6/v0(6))1/2]  . 

00  flc*  Tc  "  Tc  and 

T  T  T 

(2.14)  |E  xi_1(ei-E0e1)  -  E  x1_1e1 |  -  [2  xi_1(e1-EQe1) |  . 

By  Wald's  identity  (cf.  Chow,  Robbins,  and  Siegmund,  1971,  p.  23) 

(2.15)  Eq[c'1/2  I  xi_1(l1-EeIi)l2  -  c'1(l-v0(6))E0(Z  x2^) 

<  (l-v0(6))(l+62) 

The  Proposition  follows  from  (2.11)-(2.15)  by  letting  6  -*•  0, 

For  ease  of  reference  we  state  without  proof  the  following  lemma. 

It  is  related  to  the  strong  law  of  large  numbers  given  e.g.  by  Neveu 
(1965,  p.  148),  whose  method  of  proof  can  be  adapted  to  the  present  purpose. 
Alternatively  it  follows  easily  from  Proposition  2  of  Robbins  and  Siegmund 
(1971)  and  a  straightforward  calculation  along  the  lines  of  their  Lemma  1. 

Lemma  2.2.  Under  the  measurability  assumptions  of  Proposition  2.1,  (2.1), 

and  (2.3),  for  each  y>  ■j-  and  increasing  sequence  of  positive  constants 

c  -*■  +  <*>,  and  for  each  6  >  0 
n 

^  ®  2  v 

sup  P0{|Z  x.  .e. I  >6  max  (c  ,  (E  xf  ,)T)  for  some  n  >  m}  *►  0 

o  8  i  i-i  i'  “  n  i  1-1 

as  m  ®. 

We  now  return  to  the  autoregressive  model  (1.1)  and  write  P0  to  denote 
dependence  of  probabilities  on  the  parameter  0.  (The  joint  distribution  of 


7 


Xq.Ej.Ej .  however,  is  assumed  not  to  depend  on  BO 

result  of  this  section  is 

Theorem  2.1.  Define  {b  ,  n  ■  2,3,...}  by  (1.2)  and  N 

n  c 

2 

If  e^, ££»...  are  i.l.d.  with  mean  0  and  variance  a, 
independent  of  x^,  then 

N 

c  9 

lio  Pg{(E  xJ^Xb  -8)  <  t>  -  *(t/o) 
c  ♦  *  1  c 

uniformly  for  -1  <_  8  <.  1  and  -®  <  t  <  <». 

Proof .  Theorem  2.1  follows  immediately  from  Proposition  2 
verified  (2.6).  To  this  end,  note  that  squaring  (1.1)  and 

9  9  ®"1  9  9  ®  9  ® 

(2.16)  x‘  +  (1-80  E  xt  -  x‘  -  Z  £t  +  28  E  x.  ,e, 

i-0  1  U  1  1  i-1  1-1  1 

Let  ] @ 1  <  1  and  0  <  X  <  a2/ 4.  Let 


(2.17)  nm>A«{|n_1  E  e2-o2|  <  X,  |E  x^eJ  <  max(Xn,(E  x*_. 


On  if  n  >_  a  and  xR  <  Xn,  then  (2.16)  implies 


n-1 


E  x?  >  (02-X)n  -  Xn  -  2  max  (Xn,(E  x?  ,)2/3) 

0  1  l  1-1 


and  hence  for  all  a  sufficiently  large 


n-1 


2  E  xj  >  (o2-4X)n  >  (o2X_1-4)x2 

^  x  1  n 


The  principal 

by  (1.6). 
and  are 


.1  once  we  have 
summing  yields 


)2^3)  for  all  n>m} 


(2.19) 


I 


t 


n}<?\  tyt*  ■ 


On  the  other  hand,  since  l^.jJ  >  l Bxn_1 1  >  (xj  -  (ej,  it  follows 
that 


k-1 


k-1 


^  |x  |  >  |x  |  -  Z  |e  |  >  |x  \{1  -  £  |e  .]/(An)1/2} 
1  <  j  <  k  n  3  n  >0  n  3  n  j=*0  n  3 


2  2 
if  x  >  Xn.  Hence  n  >  k  and  x  >  Xn  imply 
n  —  —  n  — 


(2.19) 


n_1  2  ,2  .  .  2,  k_1 


Z  x*  ./x^  >  k‘{l  -l  |e  ,|/(Xn)1/2}  j 
0  j-o  n-3 


k-1 


and  since  £  |e  |,  n  ■  k,k+l,...  are  i.i.d.  with  finite  second  moment, 
j*0  n  3  _ 

the  right  hand  side  of  (2.19)  converges  to  k  with  probability  one,  at  a 
rate  which  does  not  involve  g.  Hence  by  choosing  A  so  small  that 
2/(o2A  *-4)  <  6  and  k2  >  1/6,  we  see  by  (2.18)  and  (2.19)  that 


2  n— 1  £ 

lim  sup  Pfl{x  >  6  £  x.  for  some  n  >  m} 
m-*-«o|g|<lPn  0  i 

<  lim  sup  Po(^  ,)  , 

m  -v  «  |  @1  <  1  0  m’X 


which  equals  0  by  Lemma  2.2  and  the  strong  law  of  large  numbers.  This 
establishes  (2.6)  and  hence  the  theorem. 

3.  Monte  Carlo  Results. 

In  this  section  we  report  the  results  of  a  Monte  Carlo  experiment  to 
compare  the  fixed  sample  size  and  sequential  asymptotic  distributions.  The 
basic  experiment  to  assess  the  accuracy  of  the  normal  approximation  indicated 
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by  (1.4)  and  (1.7)  consisted  of  a  frequency  count  of  the  number  of  times 

the  normalized  estimator  of  8  exceeded  z  or  was  less  than  -z  for 

commonly  used  quantiles  z  of  the  standard  normal  distribution.  Since 

very  similar  results  were  obtained  for  various  z,  we  report  here  only 

for  z  ■  1.28,  for  which  the  (one-tailed)  probabilities  are  nominally 

0.10.  For  simplicity  Xq  *  0,  and  ei»e2***‘  were  taken  to  be  N(0,1). 

In  the  fixed  sample  experiment,  n  ■  50  observations  were  taken;  and  the 

results  are  reported  in  Table  1.  In  Table  2  observations  are  taken 

sequentially  with  c  chosen  so  that  EgNc  "50  for  all  8,  In  Table 

3  c  "  50  and  EflN  varies  with  8* 

P  c 

For  normally  distributed  e^,  bn  (b^  )  falls  to  be  normally  distributed 

c 

n  £  Nc  2 

only  because  of  variability  in  Z  xf  ,  (Z  x.  .).  (See  Dvoretzky,  1972,  p.  520) 

1  1 

Of  course,  the  sequential  experiment  is  designed  to  reduce  this  variability. 

The  columns  of  Tables  1-3  below  with  the  headings  a^  and  s_ d  report 

2 

the  observed  average  and  standard  deviation  of  Ex^_^  respectively. 

2 

Variability  for  Ex^  ^  in  the  fixed  sample  experiment  goes  into  variability 

in  for  the  sequential  experiment,  so  Tables  2  and  3  also  report  estimates 

1/2  2 

of  EgNc  and  (vargN£)  .  Note  that  variability  in  Ex*_^  for  the  fixed 

1/2 

sample  size  case  and  (var^)  /EgNc  for  the  sequential  case  increase 
dramatically  as  8  approaches  one. 

The  columns  headed  pf  and  report  the  percentage  of  excesses  in 

the  right  and  left  tails  of  the  distributions. 

The  figures  in  Tables  1  and  2  indicate  that  the  fixed  sample  size 
asymptotic  theory  is  not  especially  good  when  n  ■  50,  even  for  small  |8|, 
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TABLE  1 


t ~y ad  Sample  Case 


m  ■  50,  z 

-  1.28,  p 

r 

and 

p^  are  nominally  0.10 

8 

/V 

pr 

A 

p£ 

a 

XX 

s 

XX 

0.1 

.084 

.108 

49 

10 

0.5 

.086 

.118 

65 

18 

0.9 

.052 

.136 

232 

136 

1.0 

.048 

.166 

1272 

1505 

TABLE  2 


Sequential  Case 


Z  * 

1-28,  pr 

and  p^ 

are  nominally 

0.10 

8 

A 

pr 

pJl 

c 

a 

XX 

s 

XX 

Vc 

(vargNc)1/2 

0.1 

.094 

.105 

50 

52 

1.7 

52 

10 

0.5 

.103 

.096 

65 

67 

2.2 

52 

13 

0.9 

.103 

.099 

200 

207 

8.0 

51 

21 

1.0 

.098 

.101 

500 

524 

22 

48 

24 

TABLE 

3 

Sequential  Case 

c  ■  50,  z 

-  1.28, 

Pr  and 

p ^  are  nominally 

0.10 

_ 

e  Pr 

a 

XX 

S 

XX 

W 

<™Vc)1/2 

.5  .097 

.099 

52 

2.4 

41 

11 

.9  .092 

.102 

55 

5.4 

20 

9.0 

1.0  .108 

.107 

58 

8.2 

16 

7.6 

1.1  .096 

.093 

61 

10 

13 

5.9 

11 


and  it  datariorataa  qulta  noticeably  for  6  near  1.  In  the  sequential 
case  the  asymptotic  theory  is  auch  better  and  shows  no  dependence  upon 
the  value  of  0. 

4.  Additional  Asymptotic  Theory. 

Here  we  give  some  additional  asymptotic  results,  which  follow  from 

the  techniques  developed  in  Section  2.  Theorem  4.1  describes  the  asymptotic 

behavior  of  Nc>  and  to  some  extent  explains  the  rather  surprising  differences 

between  the  fixed  sample  and  sequential  cases.  Theorem  4.2  is  concerned 

with  the  uniform  strong  consistency  of  b  and  O  *  n  £  (x.-b  x,  ,)  . 

“  n  i-1  1  "  1-1 

It  provides  the  foundation  for  consideration  of  the  case  of  unknown  o. 

Theorem  4.1.  Under  the  conditions  of  Theorem  2.1, 

(i)  for  each  Be (-1,1),  Pg{  lim  -  (1-B2))  -  1. 

and 

(ii)  for  |0|  -  1,  c"1/2N  I  inf{t:/  W^sjds  -  1>, 

c  0 

where  W(t),  0  <  t  <  *,  is  a  standard  Brownian  notion  process. 

Remark.  In  addition  to  containing  information  on  the  sample  else  of  our 

sequential  procedure.  Theorem  4.1  has  Interesting  connections  with  Theorem  2.1 

and  a  theorem  of  Anscombe  (1952).  As  generalised  by  Mogyorldi  (1962)  Anscombe1 s 

r 

theorem  says  that  If  Y  *1,  some  additional  technical  conditions  are  satisfied, 

U 

and  if  v(c)  are  integer-valued  random  variables  which  can  be  normalised 
by  constants  k(c)  ■*•+«•  in  such  a  way  that  v(c)/k(c)  converges  in 
probability  to  a  positive  random  variable,  then  .  £  Y,  Hence  (1.4), 

Theorem  4,1  (1),  and  Anscombe1  s  theorem  show  that  (E  x^)  '  (b^ 


-0)  $  N(0,1) 
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for  each  fixed  $e(-l ,1) .  However,  because  the  convergence  of  Theorem 
4.1  (ii)  is  in  law  and  not  in  probability,  Anscombe's  theorem  is  not 
applicable  for  |8|  -  1,  and  in  fact  its  conclusion  would  be  Incorrect. 

Proof  of  Theorem  4.1. 

On  the  event  ^  defined  in  (2.17),  (2.16)  iaplles  for  all  n  £  a 


(4.1)  lx*  -  x*  +  (1-8*)  E  x*_x  -  no*|  <  3Xn  +  2(E  x*  x) 


2  n  2 

t*  > 


2  ,2/3 


If  | 3|  is  bounded  away  from  1,  say  |P|  £  P  <  1,  so  1  -  3*  ^  1  -  p*  >  0, 
then  (2.6),  (4.1),  and  Pfl(Q  , )  1  (uniformly  in  3)  imply  that 

p  m,A 


(4.2)  lim  sup  Pft{ | (1-B2)n_1  Ex*  -  az|  > 

»--  !3l<p  B  1  i‘1 


1*1  <p 


6  for  some  n  >  n}  ■  0 


Theorem  4.1  (i)  follows  easily  from  (4.2). 

If  8*1,  then  x  ■  x„  +  S  ,  where  S  ■  e.  +  •••  +  e  .  Thus 
nun  n  x  n 

Theorem  4.1  (il)  follows  from  Donsker’s  Theorem,  which  implies  that 

-1  tcl/2t]  2  Z  2  1  2, 

{c  1  E  S7,  t  >  0}  ?  { o 1  f  W*(s)ds,  t  >  0)  . 

i-1  1  0 


A  similar  but  slightly  more  complicated  argument  handles  the  case  8  *  -1. 


Theorem  4.2.  Define  the  least  squares  estimate  for  8  as  in  (1.2),  and 

2 

in  the  case  of  unknown  0,  estimate  o  at  stage  n  by 


(4.3) 


ao  .i  11  2 

o‘  -  n  1  E  (x.-b  X.  ,)Z  . 

n  i-i  1  n  1-1 


A  7  ,  , 

bR  and  0Q  are  uniformly  consistent  for  |8|  <  1  in  the  sense  that 


for  all  6  >  0 
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(4.4)  lim  sup  Pfl{|b  -0|  >  fi  for  sob*  n  >  a)  -  0 

a  oo  |g|  <  i  P  n 

and 

(4.5)  lla  sup  Pa{|a?-a2|  6  for  sob*  n  >  a}  -  0  . 

m  -* »  |e|  <  i  e  n 


Proof.  From  (2.6),  (2.16),  and  (4.2)  it  is  easy  to  see  that  for  all 
0  <  A  <  1 


_1  u  2  2 

sup  PQ{n  E  x,  ..  <  Ao  for  some  n  >  m)  ■*>  0  (m  -*•  •»)  , 

|S|  <  1  0  1  1-1  _ 


which  together  with  (1.2)  and  Lemma  2.2  proves  (4.4). 
To  prove  (4.5)  note  that 

a2  -  n-1  E  (e  +  (6-b  )x.  ,)2 
n  i-1  1  n  11 

(4.6) 

n  _  n  2  n  2 

-  n  1  E  -  (  Z  x.  . E.)2/n  E  x2 
1  1  i-1  x  1  x  i-1  1 


For  |0|  <  1,  |xn|  <  |xQ|  +  E  (e^J  -  UQ,  say,  where  the  distribution  of 

1  n  2  2  4 

U  does  not  depend  on  0.  Moreover,  Ex.  ,  <  E  U‘  -  o(n  )  with 

1  l-i  -  0  * 

probability  one.  Hence  by  Leans  2,2 


n  2  n  2 

lin  sup  Pfl{(E  x.  ,c.)  >  6i  I  x:  .  for  sob*  n  >  m)  -  0  , 

m-«  |0|  <  1  8  1  1-1  1  "  1  i_1 


which  along  with  (4,6)  and  the  strong  law  of  large  nuabers  implies  (4.5). 

With  the  help  of  (4.5)  it  is  possible  to  aodify  the  definition  of  Mfi 
to  handle  the  case  of  unknown  o.  The  following  result  can  be  proved  along 


the  lines  of  Theorea  2.1,  elthough  the  details  ere  considerably  aore 
coaplicated.  The  proof  is  emitted. 

Theorea  4.3.  Define  b  bv  Cl. 2)  and  a2  by  C4.3).  Let  {6  }  be  a 
“  n  Q  U 

sequence  of  positive  constants  with  6  0.  Let  s2  -  aax(6  ,3?)  and 

n  n  n  n 

for  c  >  0  define 

A  Q  a  a 

(4.7)  Nc  ■  inf{n:  n  _>  2,  £  t.  cs  / 

c  1 

Then  as  c  * 

A 

pB{(IC  x^)172^  -g)/SS  <  t}  -  *<t) 

1  c  c 

uniformly  in  |B|  <,  1  and  -»  <  t  <  *. 
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